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Abstract. This paper presents a nonparametric method for estimating the conditional 
density associated to the jump rate of a piecewise-deterministic Markov process. In our 
framework, the estimation needs only one observation of the process within a long time 
interval. Our method relies on a generalization of Aalen's multiplicative intensity model. 
We prove the uniform consistency of our estimator, under some reasonable assumptions 
related to the primitive characteristics of the process. A simulation example illustrates 
the behavior of our estimator. 



1. Introduction 

This paper is devoted to the nonparametric estimation of the jump rate for piecewise- 
deterministic Markov processes, from only one observation of the process within a long 
time interval. Our approach is based on methods investigated in the previous work of the 
authors [ ] and a generalization of the well-known multiplicative intensity model, developed 
by Aalen in [1, 2, 3] in the middle of the seventies. 

Piecewise-deterministic Markov processes (PDMP's) have been introduced in the liter- 
ature by Davis in [13] as a general class of non-diffusion stochastic models. They are a 
family of Markov processes involving deterministic motion punctuated by random jumps. 
The path depends on three local characteristics namely the flow the jump rate A, which 
determines the interarrival times, and the transition kernel Q, which specifies the post- 
jump location. A suitable choice of the state space and the local characteristics <1>, A and 
Q provides stochastic models covering a large number of problems, for example in reliability 
(see [J .!] and [8]). Denote by / the conditional density of the interarrival times associated 
to A. This is a function of two variables: a spatial mark and time. The purpose of this 
paper is to develop a nonparametric procedure to estimate this function, when only one 
observation of the process within a long time is available. To the best of our knowledge, 
the estimation of the conditional distribution of the interarrival times for this class of sto- 
chastic models has never been studied. Furthermore, this paper relies on [G] in which we 
focus on the nonparametric estimation of the jump rate and the cumulative rate for a class 
of non-homogeneous marked renewal processes. This class of stochastic models amounts 
to considering a particular piecewise-deterministic process, whose post-jump locations do 
not depend on interarrival times. 
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As counting processes may model a large variety of problems, nonparametric and semi- 
parametric estimation methods have been developed by many authors for their statistical 
inference. The famous multiplicative intensity model has been extensively investigated 
by Aalen since 1975 (see [1, 2, 3]). This model postulates the existence of a predictable 
process Y and a deterministic function A, called the jump rate or the hazard rate, such 
that the stochastic intensity of the underlying counting process is given by the prod- 
uct Y\. In this context, Aalen provided a useful method for estimating the cumulative 
rate A(t) = /q A(,s)ds. The associated consistent estimator is now called the Nelson-Aalen 
estimator. In 1983, Ramlau-Hansen focused on smoothing this estimator by some kernel 
methods, in order to estimate directly the jump rate A. A nonparametric estimate of the 
rate A has been provided in [23]. 

As mentioned before, a large number of estimation problems are related to the estimation 
of jump rates depending on both time and a spatial variable. The Nelson-Aalen estimator 
is proved to be well-adapted for a large variety of developments and applications (see the 
book [ :] and the references therein), in particular in survival analysis, or in statistics of 
processes. For example, one may apply Aalen's approach for estimating the jump rate 
of a marked counting process, whose state space is finite, from independent observations. 
More recently, Comte et al. proposed in [10] a new strategy for the inference for counting 
processes in presence of covariates, under the multiplicative assumption. 

Semiparametric estimation methods have been mainly investigated in presence of con- 
tinuous covariates, beginning with Cox [11]. One may refer the reader to the book [5] and 
the references therein for a large review of the literature on these models. There exists 
also an extensive literature on nonparametric approaches when the spatial mark takes its 
values in a continuous space. We do not attempt to present an exhaustive survey on this 
topic, but refer the interested reader to [ , 5, 16, 1!)] and the references therein for detailed 
expositions on these techniques. In particular, McKeague and Utikal proposed in 1990 a 
nonparametric estimator of the jump rate when the covariate belongs to [0, 1] (see [20]). 
Their approach is based on a generalization of Aalen's multiplicative model. It consists 
in smoothing a Nelson-Aalen type estimator both in spatial and time directions. The au- 
thors demonstrated the uniform convergence in probability of their estimator. Li and Doss 
extended in turn McKeague and Utikal 's work for the multidimensional case in [In]. This 
paper relies on a local linear fit in the spatial direction. Their theoretical results concern 
the weak convergence of the proposed estimators. The interested reader may also consult 
the papers written by Utikal [25, 26]. These two papers deal with the nonparametric es- 
timation of the jump rate for two special classes of marked counting processes, observed 
within a long time, under some continuous-time martingale assumptions. The Euclidean 
structure of the covariate state space plays a key role in the papers mentioned above. At 
the same time, the nonparametric approach has been considered by Beran [7], Stute [24] 
and Dabrowska [12], but in the independent and identically distributed case. 

Our approach relies on our previous work [6] and a generalization of Aalen's multiplica- 
tive model. The main difficulty is related to the dependence of the transition kernel on 
the previous interarrival time. This excludes the techniques developed in the literature 
[6, 18, 20, 25, 26] for estimating the jump rate A. The keystone of the present paper is 
to consider the Markov chain (Zn, Zn+i, Sn+i)n>o, where the Z^s denote the post-jump 
locations of the process, and the S^'s denote the interarrival times. The main idea in this 
work is to deal with the conditional distribution of Sn+i given Z„ and Zn+i- We prove that 
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this conditional distribution admits a jump rate A, under some regularity conditions on the 
primitive data of the process (see Proposition 3.8). Furthermore, a conditional indepen- 
dence result is satisfied by the discrete-time process {Zn, Zn+i, Sn-\-i)n>o (see Proposition 
5.8). In this context, we focus on the estimation of the jump rate A, which is a function of 
three variables: two spatial marks and time. Moreover, the two spatial variables take their 
values on a general metric space. In particular, this rules out the procedures investigated 
by the authors mentioned above [18, 20, 25, 26]. As a consequence, our method consists 
in involving a thin partition of the state space. We take a leaf out of a few proofs of our 
previous work [G] for estimating the function l(A,B,t), which is an approximation of the 
jump rate X{x,y,t), for x € A and y £ B. In the rest of the paper, we use the conver- 
gence property of this estimator to tackle the estimation problem of the density of interest 
/. We study the connection between A and the conditional density / (see Proposition 
6.7). This link involves the conditional probability P^{Si > t,Zi S B\Zo E A), where v 
denotes the invariant measure of the process {Zn)n>o- An efficient estimate of this quan- 
tity is presented in Proposition 6.10. We finally provide a nonparametric estimator of the 
conditional density /, and we prove a result of uniform convergence in Theorem 6.11. An 
inherent difficulty is related to the presence of constrained jumps, when the process reaches 
the boundary of the state space. Moreover, we ensure the consistency of our estimator, 
under interpretable and reasonable conditions related to the primitive characteristics of 
the process. 

The paper is organized in the following way. We first recall, in Section 2, the definition 
of a PDMP. Next, we introduce a new process, whose transition kernel does not depend on 
time. Section 3 is devoted to the existence of the conditional jump rate A of this Markov 
process (see Proposition 3.8). In Section 4, we state some ergodicity results, which will 
be useful in order to prove the uniform convergence of our estimator. Section 5 relies on 
some proofs given in [(!]. In this section, we propose an estimator of the function 1{A, B, t), 
which is an approximation of the jump rate X{x,y,t) for x €z A and y £ B. The main 
contribution of the paper lies in Section 6. We provide a nonparametric estimator of the 
conditional density / associated to A, by studying the link between / and the jump rate A. 
Our main result of consistency is presented in Theorem 6.11. Finally, a numerical example 
is given in Section 7 for illustrating the good behavior of our estimator. The technical 
proof of a conditional independence result (Proposition 5.8) is deferred in Appendix A. 

2. Definition of a PDMP 

This section is devoted to the definition of a piecewise-deterministic Markov process on 
a separable metric space. The process evolves in an open subset E oi a separable metric 
space {£, d). The motion is defined by the three local characteristics (A, Q, <I>). 

• ^ : E X R+ E is the deterministic flow. It satisfies, 

G E, Vs, t > 0, $(C, t + s) = $($(e, t), s). 
For each £ E, t*(^) denotes the deterministic exit time from E: 

t*{() = mf{t > : «>(e,t) G dE}, 
with the usual convention inf = -|-oo. 
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• A : -B — 7- R^. is the jump rate. It is a measurable function which satisfies, 

£E, 3e>0, I A($(^, s))ds < +00. 
Jo 

• Q is a Markov kernel on {E,B{E)) which satisfies, 

\/ ^eE, Q{^,E\{^}) = 1 and Q{^,E) = 1. 

There exists a filtered probability space (^},A, {J^t)t>o, Pfo); which the process {Xt)t>o 
is defined (see [13]). The probability distribution of the initial value Xq is vq. Starting 
from X € E, the motion can be described as follows. Ti is a positive random variable whose 
survival function is, 

Vt > 0, P,o(Ti > t\Xo = x) = exp (^-^ A($(C,s))ds^ l{o<t<i*(x)}- 

One chooses an £^-valued random variable Zi according to the distribution Q(<I>(^, Ti), •). 
Let us remark that the post-jump location depends on the interarrival time Ti. The 
trajectory between the times and Ti is given by 

r ^tt) forO<t<Ti, 
* \ Zi foTt = Ti. 

Now, starting from Xti, one selects the time S2 = T2 — Ti and the post-jump location 
Z2 in a similar way as before, and so on. This gives a strong Markov process with the 
Tfc's as the jump times (with Tq = 0). One often considers the embedded Markov chain 
{Zn, Sn)n>o associated to the process {Xt)t>o with Zn = Xt„, Sn = Tn — Tn-i and Sq = 0, 
that is, the Z^s denote the post-jump locations of the process, and the S'„'s denote the 
interarrival times. 

On the strength of [13] (Chapter 1, Section 24 Definition of the PDP), the embedded 
chain {Zn, Sn)n>o is generated by a stochastic dynamic system. There exist two measurable 
functions ip and ijj, and two independent random sequences (en)n>o and {6n)n>o, such that, 
for any n > 1, 

QN \ Sn = f{Zn-l,Sn-l), 

\ Zn = 'lp{Zn-l,Sn,en-l)- 

It appears natural to introduce the one-jump counting process A^'"*"^, for each integer i, 
given for any t > by 

and {Tl^^)t>o its natural filtration. Finally, for each integer n, denote by Gn the cr-field 
(t{Zq, . . . , Zn)- For a matter of readability, we introduce also the following notations, 

veei?, Vt>0, _A(e,t) = A(<I>(C,t)), 

Vee^, Vt>0, VAGi3(^), Q{i,t,A) = Q{m,t),A). 

In all the sequel, let us denote by / and G the probability density function and the survival 
function associated to the jump rate A. 

€E,yt> 0, G(^, t) = exp A(^, s)As^ , 

V^Gi?, Vt>0, /(e,t) = \{i,t)G{i,t). 
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The purpose of this paper is to provide a nonparametric estimate of the conditional density 
/. We shall prove the consistency of the estimator from some assumptions related to the 
characteristics of the process. 



3. Conditional distribution of Sn+i given Z„, Zn+i 

In this section, we show that the conditional distribution of Sn+i given Z„ and Zn+i 
admits a jump rate (see Proposition 3.8). This result directly induces a corollary about the 
compensator of the counting process A^^+i in a particular filtration (see Corollary 3.10). 
First, some assumptions on the characteristics of the process are presented. In particular, 
we assume that the transition kernel Q admits a density according to an auxiliary measure 
fi on {E,B{E)). 

Assumption 3.1. The transition kernel Q may be written in the following way, 
eE,ys> 0, yB G B{E), m,s,B) = [ Q{^,s,y)fi{dy), 

JB 

where /x is an auxiliary measure on (E,B{E)). 

Furthermore, we impose some conditions on both the measure fi and the associated density. 
Assumptions 3.2. 

a) For any measurable set B with non-empty interior, f^{B) > 0. 

b) For any x,y €z E, Q{x, -^y) is a continuous function. 

c) There exists m > such that, 

(2) Vx eE, Vs > 0, Vy E E, Q{x, s, y) > m. 

Now, we impose some regularity conditions on the density / and the jump rate A. 
Assumptions 3.3. 

a) /(^, •) is a continuous function for any £ E. 

b ) There exists a locally integrable function M : R-|_ — t- R-|- such that, 

£ E, yt> 0, A(e,t) < M{t). 

For the sake of clarity, let us introduce the following notations, 

(3) Ve eE,ys> 0, yy e E, GQ{t s, y) = G(e, s)Q(C, s, y), 

(4) G Vs > 0, yy G E, fQ{i, s, y) = f{^, s)Q{(, s, y). 
Furthermore, we denote also, 

(5) G ^, Vs > 0, G e(^), GQ(^,s,B) = G(e,s)Q(e,s,5), 

(6) Ve G ^, Vs > 0, yB G B{E), fQit s, B) = f{t s)Q(C, s, B). 

We shall establish that G{x,t*{x)) and GQ{x,t*{x),y) are two strictly positive numbers 
for any x,y £ E. 
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Remark 3.4. Let x,y & E. On the one hand, we have 
(7) 



G{x, t*{x)) > exp f - y M{s)ds j > 0, 



because M is a locally integrahle function. On the other hand, from equations (2) and (3), 
we have 



(8) 



GQ{x,e{x),y) > mG{x,t*{x)) > 0. 



Let us denote by R the transition kernel of the Markov chain (Z„)„>o. In the following 
remark, we especially give an explicit formula for R. 

Remark 3.5. The kernel R may be written in the following way [ , (34.12), page 116], 
for any x e E, B e B{E), 

fQ{x, s, B)ds + GQ{x, t*{x),B), 



(9) 



R{x,B) 



where the functions GQ and fQ have already been defined by (5) and (6). Furthermore, 
since the transition kernel Q admits Q as a density according to the measure fi, one may 
also write 



(10) R{x, B) = j / * fQ{x, s, y)ds + GQ{x, t*(x), y) 

Together with (7) and (8), 

R{x,B) > G{xX{x)) l_Q{xX{x),y)Kdy) 

(11) 



/i(dy). 



B 



> mii{B) exp ( - y M{s)ds 



In particular, if Bi^ 0, R{x,B) > because f^{B) > according to Assumptions 3.2. 

Let us denote by f„ (resp. by z/„, by r/„) the distribution of Z„ (resp. of the couple 
{Zn, Zn+i), of {Zn, Zn+i, Sn+i))- The following remark deals with the relation between 
Un and the transition kernel R. 

Remark 3.6. Let n be an integer and A x B £ B{E)®'^ . One may write 

Dn{A xB) = P^„(Z„+i G 5, Z„ G A) 



(12) 



R{x, B)h'n{^x). 



We focus our attention on the relation between the probability measures rjn and i^n- 
Remark 3.7. Let t > and B G B{E). We have 

Pi/o('S'n+l > ^1 G B\Zn) 



'-{0<t<t*(Z„)} 



Mt*(Z„) 



fQ{Zn, s, B)ds + GQ{Zn, t%Zn),B) 
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This obviously induces that, for any A,B & ^{E) and t > 0, 
r/„(A X Bx]t, +oo[) 

(13) = / l{o<t<tHx)} / fQ{x,s,B)ds + GQix,t%x),B) Un{dx). 

JA JtAt*{x) 

The main result of this section hes on the following proposition. It deals with the existence 
of a jump rate for the conditional distribution of Sn+i given Zn, Zn-^-i. 

Proposition 3.8. Let n he an integer. The conditional distribution of Sn+i given Zn, Zn+i 
satisfies, for any t > 0, 

Puo{Sn+i > t\Zn,Zn+i) = exp I- J A(Z„ , Z„+i , s)ds j l{0<t<t*(Z„)}, 

where the jump rate A is defined for any x,y £ E, < t < t*{x), by 

(14) X{x,y,t)- 



/; fQ{x, s, y)ds + GQ{x, t*{x),y) 

Proof. Let x,y € E. X{x,y,-) is a continuous function on the interval [0, t*(x)] because 
f{x, •) and Q{x, •, y) are two continuous functions in the light of Assumptions 3.2 and 3.3. 
The survival function G associated to A is defined for any x,y £ E, < t < t*{x), by 

(15) G{x,y,t) = exp ( - X{x,y,s)ds]. 







Moreover, for any <t < t*{x), X{x,y,t) = —u'{t)/u[t) with 



u{t) = ^ /Q(x, s, y)ds + GQ{x, t*{x),y). 



As a consequence, we have 

rt ^ ( ft*(x) 



/ A(x,y,s)ds =-ln / fQ{x,s,y)ds^GQ{x,t{x),y) 

Jo \Jt y 

+ ln(y^ fQ{x,s,y)ds + GQ{x,t*{x),y) 



1^"^ fQ{x,s,y)ds + GQ{x,t%x),y) 
^ /Q(x, s, y)ds + GQix, t^{x),y) ^ 



In 



Finally, together with (15), 
(16) Gix,y,t) 



/f^"^ fQ{x,s,y)ds + GQ{x,t*{x),y) 
fo^"^ fQ{x, s, y)ds + GQ{x, t*{x),y) ' 
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In order to establish the expected result, we need to prove the equality 

(17) r]n{A X Bx]t, +oo[) = y, t A t*(x)) l{o<t<t*(^)}i?n(dx x dy), 

JAxB 



AxB 
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for any A,B ^ B{E) and t > 0. By (12), we have 

G(x, y, t A t*{x)) l{Q<t<t*(x)}Vn{(^x X dy) 

= I G{x,y,t At*{x))l{o<t<t*{x)}Rix,dy)i'n{dx). 

J AxB 

Thus, with (10) and (16), we obtain 

G{x, y, t A t*{x)) l{o<f<t*(^)}i7„(dx x dy) 



AxB 



^{0<t<t*(x)} 
AxB 

l{0<t<t*{x)} 

A 



tAt*(x) 
t*{x) 

tAt*{x) 



fQix, s, y)ds + GQ{x, t''{x),y) //(d?/)f„(dx) 
fQ{x, s, B)ds + GQ{x, t*{x),B) i/„(dx). 



Together with the expression (13) of r/„, this directly imphes (17) and, therefore, the 
expected result. □ 

Remark 3.9. Let n he an integer. On the strength of Jirina's theorem (see for instance 
Theorem 11.7 of [22]), there exists a kernel family i'~fx,yi'))(x.y)eE^ such that for any A x 
B xT m BiE)®"^ (g) ^(R+), we have 



r]n{A X B xF) = / jx^y{T)un{dx x dy). 

J AxB 



Let x,y G E'^ . By Proposition 3.8, ^x,y does not depend on n. Furthermore, we have the 
relation 

'yx,y{[t,+oo[) = PuoiSi > t\ Zq = x,Zi = y) 
= G{x,y,t), 

ift<t*{x), by (17). 

We also have the following continuous-time martingale property. 

Corollary 3.10. Let i he an integer. The continuous-time process M*"^^ given by, 

(18) VO < t < t*{Zi), M'+\t) = N'+\t) - ['x{Z„Zi+i,u)l{s,^^>^}du, 

Jo 

is a {a{Zi, Zi-^i) \/ J-l^^)Q<:t^f*(^Zi)''^ontinuous-time martingale. 

Proof. The proof is similar to the one of Lemma 2.2 of [()]. Indeed, the conditional jump 
rate of Si+i given Zj, Zj+i is X{Zi, Zi^i, ■) by Proposition 3.8. □ 



4. Ergodicity 

In this section, we focus our attention on the asymptotic behavior of the Markov chains 
{Zn)n>o, iZn,Sn+i)n>o and {Zn, Zn+i, Sn+i)n>o- Our main objective is to state that one 
can apply the ergodic theorem to these Markov chains. Before, we impose a new condition 
on the function t*. 
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Under this new assumption, we derive uniform lower bounds for the transition kernel R 
and GQ{x, t*{x),y). 

Remark 4.2. Let x,y e E and B G B{E). By (7) and (8), we have 

(19) GQ{xX{x),y)>m2, 
where m2 is given by 



1712 = mexp — / M[s)ds > 0. 



In particular, m2 do not depend on x and y. Together with (11), we have 

(20) R{x,B)>m2^i{B). 

According to the previous remark, one may state that the Markov chain {Zn)n>o is ergodic. 
Proposition 4.3. We have the following statements: 

a) {Zn)n>o is fi-irreducible, aperiodic and admits a unique invariant measure, which we 
denote by u. 

b) There exist p > I and r > such that, 

(21) Vn > 0, sup ||i?"(^, •) - i/IL^ < r/)-" , 

where \\ ■ \\tv denotes the total variation norm (see [ ] for the definition). 

c) The Markov chain (Z„)„>o is positive Harris-recurrent. 

Proof. By definition and Remark 4.2, {Zn)n>o is ^-irreducible and aperiodic. In addi- 
tion, the transition kernel R obviously satisfies Doeblin's condition (see [21, page 396] for 
instance) , 

ti{B) > e =^ R{^,B) > 1712 e, 

by (20). On the strength of Theorem 16.0.2 of [ ], (Z„)„>o admits a unique invariant 
measure i/ since it is aperiodic and (21) holds. In addition, from Theorem 4.3.3 of [15], 
{Zn)n>o is positive Harris-recurrent. □ 

Now, we shall see that the sets with non-empty interior are charged by the invariant 
measure z^. 

Remark 4.4. The transition kernel R admits a density according to the measure /x. As 
a consequence, the invariant measure v and the auxiliary measure p. are equivalent in the 
light of Theorem 10.4-9 of[ ]. This ensures that for any measurable set A with non-empty 
interior, I'iA) > by Assumptions 3.2. 

The following lemma deals with the limits of the sequences (z7n)n>o and (^n)n>o- 
Lemma 4.5. For any initial distribution uq = (5|^}, x £ E, 

lim — =0 and lim Ikn — f/ILv = 0) 
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where the limit distributions v and rj are given by, 

(22) WAx B eB{E)^^,V{Ax B) = ! u{dx)R{x,B), 

J A 

(23) yAxBxT e B{E)®^ ® ^(R+), ??(^ xBxT)= [ jx^y{ds)D{dx x dy). 

JaxBxF 

Proof. Let g he a measurable function bounded by 1. By virtue of Fubini's theorem, we 
have 



ExE 



g{x,y)[vn{dx x dy) - u{dx x dy)) 



{un{dx) - u{dx)) / g{x,y)R{x,dy) 



from the expression of f„ (12) and the definition of i' (22). Thus, 



ExE 



g{x,y){i^nidx x dy) - u{dx x dy)) 



h{x)(^Un{dx) — v{dx)) 



where h : x ^ g{x,y)R{x,dy) is bounded by 1 because g is bounded by 1 and ii is a 
transition kernel. Finally, 

One obtains the expected limit from (21). Now, we state the second limit. Let g' a 
measurable function bounded by 1. In the light of Remark 3.9, 



< ||/i||oo||^'n — i^llry, 



g'{x, y, s) [rjn{dx x dy x ds) — r]{dx x dy x ds)) 

'ExEx'R+ 

by virtue of Fubini's theorem and with the function h given by, 

Jr+ 

As h is bounded by 1, we have 

g'{x, y, s) (^rin{dx x dy x ds) — r]{dx x dy x ds)) < — i^Wtv- 

lExExn.+ 

We previously established that ||i^n — i^Wtv tends to 0, thus ||7?n — vWtv tends to too. □ 

The previous lemma induces the following result. 
Proposition 4.6. We have the following statements: 

a) (Zn, Zn+i)n>o (resp. (Zn, Zn+i, Sn+i)n>o) is V -irreducible (resp. r] -irreducible). 

b) {Zn, Zn+i)n>o ^-^d (Zn, Zn+1, Sn+i)n>o d^c positive Harris -recurrent and aperiodic Mar- 
kov chains. 

c) V (resp. Tj) is the unique invariant measure of the chain (Z„,Z„+i)„>o (resp. of the 
chain {Zn, Zn+i, Sn+i)n>o)- 

Proof. This result is a consequence of Lemma 4.5. The proof is similar to the one of 
Proposition 4.2 given in [(3]. □ 

According to the previous discussion, the Markov chains (Z„)„>o, (Z„, Z„_|_i)„>o and 
{Zn, Zn+i, Sn+i)n>o ^re positive Harris-recurrent. As a consequence, one may apply the 
ergodic theorem to these Markov chains (Theorem 17.1.7 of [2 J]). 
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5. Estimation of / 

In this section, we focus our attention on the estimation of the function /, which is an 
approximation of the jump rate A. The precise definition of I may be found in Lemma 5.7. 
The estimation of / is a keystone in our procedure for estimating the conditional density 
/. The main result of this section states in Proposition 5.13. First, we shall impose some 
additional conditions on t*, f and Q. 

Assumptions 5.1. 

a) f is bounded. 

b) t* is continuous. 

c) Q is bounded. 

Two technical lemmas about lower and upper bounds are now presented. These results 
will be useful in all the sequel. 

Lemma 5.2. Let A and B two measurable sets, with A relatively compact and such that 
~Ar\dE = %. Thus, 

inf > 0. 

In this case, we denote t*{A) = inf^gyi In addition, for any < t < t*{A), 
(24) inf G(x,y,t)>0. 

Proof. For the first inequality, one may refer to the proof of Lemma 4.7 given in [(i]. For 
the second inequality, we have from (16) and (19), for any x,y £ E, < t < t*(x), 

Gixyt) > GQ(x,t^{x\y) 

jt*^""^ fQ{x,s,y)ds + GQ{x,t*{x),y) 
^ m2 



. +l)llQI|oo 

because /, Q and t* are bounded (according to Assumptions 5.1 and Assumption 4.1). 
This achieves the proof. □ 

One may also prove that the jump rate A is a bounded function. 
Lemma 5.3. Let x,y £ E and < t < t*{x). Thus, 

Proof. By (14), we have 

fQ{x,t,y) 



X{x,y,t) 



< 



/Q(x, s, y)ds + GQ{x, t-{x),y) 
fQ{x,t,y) 



GQ{x,t*{x),y) 
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Therefore, with (19) and since / and Q are bounded, one immediately obtains the expected 
result. □ 

Let us denote by Ci the following set, 

Ci = {BeB{E) :^/0}. 

In addition, C2 is defined by 

C2 = {a G Ci : A relatively compact set such that A n dE = 0}. 
Remark 5.4. Let A,Be Ci. Then, v{A x B) > 0. Indeed, 

V{A X B)= R{x,B)u{dx). 
J A 

For any x, R{x,B) > m2^{B) by (20), thus, 

V{A xB)> m2niB)u{A). 

One may conclude because I'iA) > by Remark 4-4 ^'''^d fJ^{B) > since B is a set with 
non-empty interior (see Assumptions 3.2). 

Let A,B £ Ci. For any integer n, one defines the process Yn{A, B, •) by, 

n-l 

(25) VO < t < e{A), YM,B,t) = ^ l{s.+,>ol{z.GA}l{z.+,eB}. 

The following results deal with the asymptotic properties of Yn- 

Lemma 5.5. Let A £ C2 and B £ Ci. Then, for any x £ E, 

yO <t<t*{A), ^■'^{A,B,t) ^ r X dy) P^.-a.s., 

n JaxB 

when n goes to infinity. In addition, this limit is strictly positive. 

Proof. By virtue of the ergodic theorem applied to the chain (Z„, Z^+i, Sn+i)n>o, 

^Yn{A, B, t)^r]{Ax Bx [t, +oo[) P^-a.s. 

Together with (23) and Remark 3.9, we have for any < t < t*{A), 
Yn{A,B,t) 



n 



I G{x,y,t)ij{dx X dy) Px-cl-s., 
JaxB 



when n goes to infinity. Since 'mfx£A,y£B G{x, y,t) > by (24) and ^{A x B) > by 
Remark 5.4, the limit is strictly positive. □ 

For any A £ C2, B £ Ci and < t < t*(A), we define the process 1^(^, 5, t)"*", which is 
the generalized inverse of Yn{A,B,t), by 

r9fi^ R / ° YM,B,t) = Q, 

(26) Yn[A,B,ty = \ 1 



NONPARAMETRIC ESTIMATION OF THE JUMP RATE FOR POMP'S 13 

Lemma 5.6. Let A £ C2, B G Ci, < t < t'*'[A) and x G E. Then, for any integer n, 

< 1 P^-a.s. 

and, as n goes to infinity, 

Yn{A,B,t)+ P^-a.s., 

l{y„(A,B,t)=o} — > Px-a.s., 







l{y„(A,B,s)=o}ds — > P^-a.s. 



Proof. This result is a corollary of Lemma 5.5. One may find a similar proof in [ii], Lemma 
4.11. □ 

The function I is defined in the following proposition. 

Proposition 5.7. Let A e C2 and B G Ci. Let < t < t*{A) and x G E. When n goes to 
infinity, 

n-l 

Yn{A, B, t)+ J2 i)l{z,eA}l{z,+ieB}l{5,+i>i} — > KA B, t) Fx-a.s., 

1=0 

where 

^27) ^ ^) ^ f^^j^X{u,v^t)G{u,v,t)u{du X dv) 

IaxB G{u,v,t)V{du X dv) 
In addition, 1{A,B,-) is continuous on [0,t*(A)[. 

Proof. This is an application of the ergodic theorem to the chain (Z„, Zn+i, Sn+i)n>o- One 
may refer the reader to the proof of Proposition 4.12 of [ ], which is similar. 1{A,B, •) is 
continuous because A and G are continuous and bounded. Therefore, one may apply the 
theorem of continuity under the integral sign. □ 

Proposition 5.8. Let n he an integer and 1 < i < n. For each j 7^ i, let tj > and t be 

a positive real number. Then, we have 

\l Fi ± Fi and Fl ± Gn- 

We deduce from Proposition 6.8 of \ ] this direct corollary. For any s < t, < i < n — 1, 
y Fi ± F^^ and F\^^ ± Qn- 

Proof. The technical proof is deferred in Appendix A. □ 

Theorem 5.9. Let A £ C2, B gCi and n be an integer. The process Mn{A,B, •), defined 
for any <t < t*{A), by 

n-l 

M^{A,B,t) = ^M^+i(i)l{z,eA}l{z,+,eB}, 
is a [Qn V y^^Q Fl^^)Q.^t^t* (^y^y continuous-time martingale. 
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Proof. One may recall that the process M*"^^ has already been defined by (18). The result 
is a corollary of Proposition 5.8 and Corollary 3.10. The arguments are given in the proof 
of Theorem 4.13 of [6] □ 

Lemma 5.10. Let A € C2, B & Ci and n be an integer. The process Mn{A,B,-), given 
for any <t < t*{A), by 

r-t 



Mn{A,B,t)= [ Yn{A,B,s)+dMn{A,B,s) 
Jo 



is a continuous-time martingale, whose predictable variation process < Mn{A,B) > satis- 
fies, for any x £ E, 

VO < t < t*{A), < Mn{A, B) > (f) ^ P^-a.s. when n +00. 

Proof. This is a consequence of Lemma 5.3, Lemma 5.6 and Theorem 5.9. A similar proof 
may be found in [n], Lemma 4.14. □ 

Remark 5.11. This immediately induces that for any A G C2, B £ Ci and <t < t*{A), 

sup \MniA,B,s)\ ^ 0, 

0<s<t 

for any x £ E, by virtue of Lenglart's inequality. A reference may be found in the book [5], 
II. 5. 2.1. Lenglart's inequality. 

In the sequel, we are interested in the estimation of the function l(A,B, •), defined by 
(27), for any A £ C2 and B G Ci. First, we shall estimate the function L{A,B, •) defined 

by, 

yO< t<t*{A), L{A,B,t)= [ T{A,B,s)ds. 

Jo 

We consider the Nelson- Aalen type estimator Ln{A,B, •) given by, 

VO<t<t*(^), Ln{A,B,t)= [ Yn{A,B,s)+dNn{A,B,s), 

Jo 

where Yn{A, B, s)~^ has already been defined by (26) and where Nn{A, B, •) is the counting 
process given by, 

n-l 

VO < t < t*{A), Nn{A,B,t) = Y.lis.^,<t}l{z,eA}l{z,+,eB}- 

i=0 

According to foregoing, the present framework is exactly the same one as in [0]. 
Proposition 5.12. Let A £ C2, B £ Ci, < t < t*{A) and x £ E. Then, 



sup 

0<s<t 



Ln{A,B,s)-L{A,B,s] 



when n — )• +00. 



Proof. This is a corollary of Lemma 5.10 and Proposition 5.7. One may refer the inter- 
ested reader to the proofs of Proposition 4.16 and Theorem 4.17 of [1], which use similar 
arguments. □ 
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We focus on smoothing this estimator in order to provide an estimate of 1{A,B,-). Let K 
be a continuous kernel whose support is [—1, 1], 6 > and < t < t*{A). We denote, 

\/0<s<t, Tn,b,M, B,s) = ^ ^* K(^)dL„(A, B, u). 

The following result deals with the asymptotic behavior of this estimator. 

Proposition 5.13. Let A € C2 and B e Ci. Let < ri < r2 < t < t*{A) and x e E. 

There exists a sequence (/3„)„>o (depending on A, B and t) which almost surely tends to 
0, such that 

sup 

ri<s<r2 

Proof. The proof relies on the arguments provided in the one of Proposition 4.23 in [' ]. □ 

As a conclusion of this section, we provided a consistent estimator of the function /. This 
is prominent in our procedure for estimating /. 



ln,fs„,t{A^B,s)-l{A,B,s) 



when n 



+00. 



6. Estimation of the conditional density / 



In this section, we shall present a consistent estimator of the conditional density of 
interest /. Our method consists in studying the link between / and /. We will use this 
relation to provide an estimate of /, and prove a result of uniform convergence in Theorem 
6.11. One considers the distance d2 on S'^ induced by the distance d and the Euclidean 
norm on R^. For any (x, y), {u, v) G 

d2{{x,y),{u,v)) = yJd{x,uY + d{y,vf. 

Let us first impose regularity conditions on /, fQ and GQ from which we shall deduce 
that A is Lipschitz (see Lemma 6.3). It will allow us to approximate A by I (see Lemma 
6.6). 

Assumptions 6.1. 

a) There exists a constant [fQ]Lip > such that, for any x,y,u,v G E and for any 
0<t< t*{x)At*{u), 

(28) \fQ{x,t,y)- fQ{u,t,v)\ < [fQ]upd2{{x,y), iu,v)) . 

b) There exists a constant [f]Lip > such that, 

\fx,yeE, Vt>0, \f{x,t)- f{y,t)\<[f]Lipd{x,y). 

c) For anyieE,t> 0, f{i,t) > 0. 

d) There exists a constant [GQ]Lip > such that, for any x,y,u,v G E, 

(29) \GQix, t*ix), y) - GQ{u, t*{u),v) \ < [GQ]upd2 ((x, y), {u, v)) . 

For the sake of clarity, we denote for any x,y £ E and < t < t*{x), 

(30) H{x, y, t) = fQ{x, s, y)ds + GQ(x, t*{x),y). 
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Therefore, by (14), we have 

H{x, y, t)X{x, y, t) = fQ{x, t, y). 
We shall estabhsh some properties of H. 
Lemma 6.2. We have the following statements: 

a) \\H\\oo < +00. 

b) For any x,y & E, <t < t*{x), H{x,y,t) > m2- 

c) Furthermore, there exists a constant [H]Lip > such that, for any x,y,u,v € E and 
0<t< t*{x)At*{u), 

(31) \H{x,y,t) - H{u,v,t)\ < [H]Lipd2{{x,y), {u,v)). 

Proof. First, by (30), we have 

H{x, y,t)< / fQ{x, s, y)ds + GQ(x, t*{x),y). 
Jo 



G is bounded by 1. In addition, /, t* and Q are bounded functions according to Assump- 
tions 5.1, Assumption 4.1 and Assumptions 6.1. Thus, 

^(X,y,t)< ||Q||oo(P1|oo||/||oo + l). 

Now, we prove that m2 is a lower bound of H. Indeed, by (30) again, for any x,y £ E and 
< t < fix), 

(32) H{x,y,t) > GQ{x,t*{x),y) > ma- 

Finally, we state that H is Lipschitz. By (30) again and by the triangle inequality, 
\H{x,y,t) - H{u,v,t)\ 

/t*{x)\Jt*(u) _ _ _ _ 

\fQ{u, s, v) - fQ{x, s, y)\ds + \GQ{u, t*{u),v) - GQ{x, t*{x),y)\. 

Thus, since the product fQ is Lipschitz by (28), we have 
\H{x,y,t) - H(u,v,t)\ 

< \\t*\\oo[fQ]Lipd2{{x,y),{u,v)) + \GQ(u,t*iu),v) - GQ{x,t*{x),y)\. 
Together with (29), we obtain (31) with 

[H]Lip = \\t*\\cx3[fQ]Lip + [GQ]Lip, 

showing the three statements. □ 
Now, one may state that A is also Lipschitz. 

Lemma 6.3. There exists a constant [Xjup > such that, for any x,y,u,v G E and 
0<t< t*{x) At*{u), 

Kx,y,t) - X{u,v,t) < [X\Lipd2{{x,y),{u,v)). 
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Proof. From (14) and (30), we have 

>^{x,y,t) - X{u,v,t) 



\fQ{x,t,y)H{u,v,t) - fQ{u,t,v)H{x,y,t)\ 



H{u,v,t)H{x,y,t) 
Therefore, together with (32), we obtain 

Kx,y,t) -X{u,v,t) < -^\fQ{x,t,y)H{u,v,t) - fQ{u,t,v)H{x,y,t)\. 



7712 

By the triangle inequahty, this induces that 
|A(x,y,t) - X{u,v,t)\ 

- —2{\fQ{x^'t^y)H{u,v,t) - fQ{x,t,y)H{x,y,t)\ 

1712 ^ 

+ \fQ{x, t, y)H{x, y, t) - fQ{u, t, v)H{x, y, t) 
< -^(\\f\\oo\\Q\\oo\H{u,v,t) - H{x,y,t)\ + \\H\\^\fQ{x,t,y) - fQ{u,t,v) 

1712 

fQ is Lipschitz in the hght of Assumptions 6.1 and H is Lipschitz by Lemma 6.2. Hence, 

\X{x,y,t) -X{u,v,t)\ < [X]upd2{{x,y),{u,v)), 
where [A] Lip is given by 

Lip 



[A] 



Lip 



7X12 

This achieves the proof. □ 
We impose a new condition on Q. 

Assumption 6.4. There exist p > 2 and a family . . . , Bp}, G Ci for any k, such 
that 

p 

max diamSfc < +oo and Vx £ E, \/t > 0, > Q{x,t, Bk) = 1. 

k=i 

Without loss of generality, Bi is assumed to be the set with the largest diameter. 

If E is bounded, then Assumption 6.4 is obviously satisfied. 

Remark 6.5. Under this assumption, one may state a new property of the measure ^. By 
{2), we have 

Q{x,t,Bk)= / Q{x,t,y)fi{dy) >7nfi{Bk). 
Summing on k yields to 

(33) 5]M^fc)<-, 

k=i 

by virtue of Assumption 6.4- 

In the following lemma, we establish that / is an approximation of A. 



\X{x,y,t)-l{A,Bk,t)\ < 



X{x,y,t) 
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Lemma 6.6. Let A £ C2, l<k<p, x£A and y £ B^. LetO <t < Then, 
(34) |A(x, y, t) - 7(^, Bk, t)\ < [X\updiam2 A x Bi. 

Proof. By (27), we have 

lAxBk ^' ^)^(^' i)2^(dti X dv) 
IaxB^ Giu,v,t)V{du X du) 

IaxB^ |A(a;,y,0 - A(u, v,t)|G('u,'(;,t)i7(du x dv) 

< ^ — 

IaxB^ Giu,v,t)i:^{du X dv) 

< [X]Lipdiam2A X Bk, 

by virtue of Lemma 6.3. This yields to the expected result, since Bi is assumed to be the 
set with the largest diameter. □ 

An approximation of the density / is presented in the following result. 
Proposition 6.7. Let A £ C2 and ^ £ A. For any <t < t*{A), 



I ^ ~ r 

fiC,t)-—j.y2l{A,Bk,t) Hix,y, 
^\^) tZl JAxBk 



t)n{dy)iy{dx] 



< —[Xjiip ||-H'||oodiam2 ^ x Bi + [fjiip diam^. 
m 



Proof. First, we show that 



1 



u{A) 



fix, t)i^idx) - liA, Bk, t) / H{x, y, t 
k=l JAxBk 



)^i{dy)v{dx] 



1 



(35) < —\\]Lip ||ii'||oodiam2^ x Bi. 

m 

Let l<k<p, x£A and y £ B^- Multiplying (34) by H{x, y, t), we obtain 

fQ{x,t,y)-l{A,Bk,t)H{ x,y,t)\ < [AJiip ||//||oodiam2 x Bi, 

because H is bounded on the strength of Lemma 6.2. We integrate on Bj. according to 
/i(dy). We obtain 



fQix,t,Bk)-liA,Bk,t) / H{x,y,t)fi{dy) 



< — Wiip ||ii'||oodiam2 A x Bi, 
m 



Summing on k between 1 and p yields to 

fix, t)-Y, Bk,t) / Mix, y, t)n{dy) 
k=i -^^k 

with (33). Finally, we integrate on A according to v{dx). 

[ fix, t)uidx) - y^TiA, Bk, t) [ Mix, y, t)uidx)fiidy) 
Ja -, J AxBi, 



< /i(5fe)[A]Lip ||if||oodiam2^ x Bi. 



(36) 



i^ip ||oodiam2 vl x Bi. 



m 
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Doing the ratio of each term of (36) by I'iA) leads to (35). On the other hand, we have 

J^f{x,t)i^{dx) 



(37) 



HA) 



< [f]LipdiamA, 



because / is Lipschitz by Assumptions 6.1. Finally, (35) and (37) give the proof by virtue 
of the triangle inequality. □ 

Let A E C2, ^ E j4 and < t < t*{A). For estimating /(^, t), we need to estimate 1{A, Bk,t) 
and 

for each 1 < k < p. We shall see that this quantity may be seen as a conditional probability. 
Proposition 6.8. Let A £ C2, 1 < k < p and < t < t*{A). Then, 

[ H{x, y, t)u{dx)fi{dy) = P^{Si >t,Zie Bk, Zq E A). 
JAxBk 

This immediately induces that 

/ H{x,y,t)uidx)fiidy) = P^{Si > t,Zi e Bk\Zo e A). 
One may recall that I'iA) is a strictly positive number according to Remark 4-4- 

Proof. By (23) and Remark 3.9, we have for any t < t*{A), 

(38) P^{Si > t, Zi E Bk, ZoeA) = 7]{A x Bk x [t, +oo[) 

G{x,y,t)V{dx X dy). 



AxBk 



Hence, 



P^(5i > i, Zi E Bk, Zo£A)= [ G{x, y, t)v{dx)R{x, dy), 

JAxBk 



by (22). Thus, by the expression of R (9), the definition of G (16) and the definition of H 
(30), we have 

G{x, y, t)R{x, dy) = H{x, y, t)ix{dy). 

Therefore, 

(39) P^(5i > i, Zi E Bk, Z^^A)= [ H{x, y, t)i^{dx)fi{dy), 

JAxBk 

showing the result. □ 

Let A G C2, I < k < p and < t < t*{A). One may estimate the conditional probability 

/ Hix,y,t)iyidx)nidy) = P^(5i > t, Zi E Bk\Zo E A), 
^{^) JAxBk 



3fe 

by its empirical version 



(40) pn{A,Bk,t)- 



J27=0 l{5,+i>t}l{Z,+iGBfc}l{Z,GA} 



Er=o ^{Z^eA} 
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We shall prove the uniform convergence of this estimator in Proposition 6.10. First, we 
establish the pointwise convergence. 

Lemma 6.9. Let A € C2 and I < k < p. For any < t < t*{A), x € E, we have as n 
goes to infinity, 



Pn{A, Bk,t) - / Hit y, t)uid^)fi{dy) 



Pa;-a.S. 



Proof. One applies the ergodic theorem to (Z„, S'„,+i)„>o. Thus, when n goes to 

infinity, 

- Yl l{z.eA}l{z,+ieB,}l{5,+i>t} ^ V{A X Bkx]t, +oo[) P^-a.s. 



n 

1=0 



Together with (38) and (39), 

(41) -y]l{z,eA}l{z,+ieBfc}l{5.+i>t} ^ / H{x,y,t)v{dx)^x{dy)Y*^-a.s. 

In addition, by applying the ergodic theorem to the Markov chain (Z„)„>o, we have 

^ n— 1 

(42) -Y,\z,eA}^y{A)Y,-a.s. 



i=0 

Combining (40), (41) and (42), we show the expected result. □ 
Now, we state that Pn{A, Bf^, •) is a consistent estimator. 

Proposition 6.10. Let A G C2, 1 < k < p and < t < t*{A). For any x ^ E, we have 
when n goes to infinity, 



sup 

0<s<t 



Pn{A, Bk, s) - / H{t y, s)u{dOKdy) 



P^-a.s. 



Proof. One considers the function /3 defined by, 

VO < t < t*{A), (3{t) = ^ / Hit y, t)u{dOfi{dy). 



k 



P implicitly depends on A and k. From Lemma 6.9, for any s, PxC^s) = 1 where the set 
is defined by 

Ts = {pn{ABk,s)^ Pis)}. 

First, we prove that /3 is a strictly decreasing function. By (30) and by virtue of the 
theorem of derivation under the integral sign, /3' satisfies, 

VO < s < t, /3'(s) = -J— [ f{ts)Q{ts,Bk)u{dO 

n{Bk)m f 



HA) JA 

by (2). According to Assumptions 6.1, / is strictly positive. Thus, /^^ /(C? •5)z^(d^) > 
because I'iA) > 0. As a consequence, /3'{s) < for any s, and (3 is, therefore, strictly 
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decreasing. In particular, this is a one-to-one correspondence mapping from [0, t] into 
[a,b], where 

[a,b] = [p{t),P,{Z^eBk\ZoeA)], 
since, in the hght of Proposition 6.8, 

P{0) = P,{Zi€Bk\Zo€A). 
For any couple {l,m) of integers, with < / < m, let us consider 

(m — l){b — a) 



X{l,m) = p-^ {a + 



m 



By construction, we have for any < / < m — 1, 



/3{X{l + l,m))- l3{X{l,m)) 



b — a 



m 



Hence, for s G [X{l,m),X(l + 1, with < / < m — 2, or for s G [X(m — l,m),t], we 
have 



(43) 



(44) 



PniA,Bk,s)- I3is) > PniA,Bk,X{l + l,m))- f3iX{l,m)) 

> Pn{A,Bk,X{l + l,m))- P{X{l + l,m)) + 



b — a 



m 



Pn{A,Bk,s)- p{s) < Pn{A,Bk,X{l,m))- f3iX{l + l,m)) 



< Pn{A,Bk,X{l,m))- (3{X{l,m)) 



b — a 



m 



because /3 and pn{A, B^, ■) are decreasing functions. Let < s < t. There are two 
possibilities: either s € [X{m — l,m),t], or there exists < / < m — 2 such that s G 
[X{l,m),X{l + l,m)[. Together with (43) and (44), 



sup 

0<s<t 



Pn{A,Bk,s) - (3{s] 



b — a 



m 



where 



Let 



an,m = sup 

0<l<m 



Pn{A,Bk,X{l,m)) - P{X{l,m)) 



= P) ^x{i,m) and Qoo = 5^?; 



(=0 



m>2 



Consequently, when n goes to infinity 

'iuj £ rim, an,mi^) 0. 

In addition, Pxi^m) = 1 b ecause is a finite intersection of sets with probability one. 
Finally, 



limsup sup 

n— >-+cc 0<s<t 



PniA,Bk,s) - /3{s] 



< inf - — - Pr-a-s., 



m>2 m 

since Pxi^oo) = 1 as a countable intersection of sets with probability one. 



□ 



Finally, our main result of convergence lies in the following theorem. 
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Theorem 6.11. Let IC be a compact subset of E and^ G E. For any e,r] > 0, there exist an 
integer N and a finite partition P = {Ai) of IC such that, for any < t < min^ t*{Ai), there 
exists for each couple {l,k), a sequence (/3n(^i, /3fc))n>o (depending on t), which almost 
surely tends to 0, such that for any n> N , for any < ri < r2 < t, 



sup sup 

\ x£lC ri<s<r2 



X] ^n,/3„(A,,Bfe),i(A, -Bfc, s)pn{Ai,Bk, s)l{^.g^,} - f{x, s) 



kl 



> r}\ < e. 



Proof. Let (Ai) a partition of IC. Let us fix Using Proposition 5.13 and Proposition 6.10, 
there exists a family of sequences {(/3n(^h -Bfe))n>o}i<fe<p) such that 



sup 

ri<s<r2 



X] ^n,/3„(A,,i?fc),t(A, -Bfc, s)pn{Ai, Bj,, s) 



k=l 



^ j2l{AuB,,s) f Hi 



u,y,s)u{du)ii{dy) 



0, 



when n goes to infinity. In addition, on the strength of Proposition 6.7, for any x G IC, the 
distance 



is arbitrarily small. The triangle inequality immediately ensures the result. 



sup 

ri<s<r2 



□ 



In the previous theorem, if the compact subset IC is close to the state space E, then the 
lower bound of the t*(^fc)'s is small, for any partition (Ak). Therefore, one estimates the 
conditional density / on a large part of E, but within a small time interval. Conversely, 
if IC is chosen centered in E, one may estimate / on a small part of the state space, but 
within a long time. 



7. Example 



In this section, we present a short simulation study for illustrating the convergence result 
stated in Theorem 6.11. We consider a PDMP {Xt)t>o defined on the state space T> x I, 
where 

V = {xe'R^ : ||x||2 < 1} and X =]0, 27r[. 
In addition, we assume that the process starts from Xq = (0,0, vr). Let us consider x = 
(xi,X2) G and G X. The flow $ satisfies, 

yt > 0, ^{{x,9),t) = {xi + tcos{e),X2 + tsm{9),e). 

The process {Xt)t>o has two components: intuitively, the first one represents the location 
in D, while the second one models the direction of the deterministic motion which takes 
place in D. The jump rate A is given by A((x, 9)) = 5 + ||x||2. Since A does not depend on 
9, we will write A(x). Finally, the transition kernel Q is defined for any A G B(R?) and 
B G fi(R), by 

Q{{x,9),Ax B) = ^ j^lviy)exp ("^lly-^i) dy ^ lx(n)du. 
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with Kx as the normahzing constant and o"^ as a parameter of variance. When a jump 
occurs, the new location on T> is chosen according to a gaussian distribution centered in 
the previous position. The new angle is randomly chosen in I. 

This process may model the movement of a bacteria in a closed environment (see for 
instance [J 4]). The bacteria moves on a line with a constant speed. It spontaneously and 
randomly changes its direction. During the rotation, the location may be a little modified 
(the parameter o"^ must be chosen small, o"^ = 10~^ in our simulation study). Next, the 
bacteria moves again on a line. A change of direction occurs also when the bacteria tries 
to run through the boundary of its environment. In our model, the jump rate A depends 
only on the distance between the bacteria and the origin. 

In the sequel, we focus our attention on the estimation of the conditional density /(xq, t) 
for xq = (0,0). We give an explicit formula of f(xo,t), 

Vt > 0, /(xo, t) = {5 + t) exp {-t{5 + t/2)) . 

For any y £ E and t, we choose to approximate the jump rate X{xQ,y,t) by 1{A, Bk,t), 
with A =]— e, e[^, e = 0.1, and Bi = A, B2 = 'D\A, that is, (-Bfc) is the simplest partition 
of D that one may consider. In this context, t*{A) = 0.9. Therefore, we decide to estimate 
l(A, Bk, t) by integrating between and 0.8, which is less than t*{A). Finally, we provide 
an estimate of / within the interval [0.05,0.75], which is a proper subset of [0,0.8]. 

We simulate a long trajectory of the process: the observation of 50000 jumps is available 
to estimate /. The number of visits in A is 5330. In addition, the chosen bandwith 
/3n{A, Bj.) can be written in the following way, 

^"^"^'^^)=/.„(Ai?,)"' 

where hn{A, B^,) denotes the random number of visits in A followed by a visit in S^., and 
a = 1/3. Figure 1 is given to illustrate the good behavior of the estimator of /. 

Appendix A. Proof of Proposition 5.8 

For the first conditional independence, let /ii, . . . , /i„ be some bounded measurable func- 
tions mapping from R_|_ into R. We have Qn C Gn (^i^n-i) and, by (1), hn{Sn) is 
Qn V (T(5„_i)-measurable. Thus, 

B,,[hi{Si)...hn{Sn)\gn] 

= E,„ E,J/ii(Si).../i„(5„)|a(5 

n— 1) V Qn\ \ Qn 

Furthermore, always by (1), (t((5„_i) V ^„ C o"((5„_i) V Qn-i V (T(e„_i). Consequently, 

E,,o [hi{Si) . . . hn-l{Sn-l)\cr{6n-l) V Qn] 

(46) = E,„ E,„ [hi{Si) . . . K-i{Sn-i)\a{6n^i) V Gn-i V a{en-i)] \a{6 

n—l ) V h/n ■ 

Nevertheless, hi{Si) . . . hn~i{Sn-i) is Gn~i V (t(5q, . . . , (5„_2)-measurable, and moreover, 

a{£n-l)V a{6n-l) -L Gn-l V a{6o, . . . , 6n-2) ■ 
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Time 

Figure 1. Estimation of the conditional density f(xo,t) with xq = (0,0) 
and 0.05 < t < 0.75. The estimate is drawn in solid line, while the exact 
density is in dashed line. 

Together with (3) [9, page 308], 

Bug [hi{Si) . . . hn~l{Sn-l)\cr{dn-l) V Gn-1 V (T(e„_i)] = E^.^ [/ll(S'l) . . . hn^liSn~l)\Gn-l] ■ 

Finally, with (46), 

[hl{Sl) . . . hn-liSn-l)\criSn-l) V On] = Ej^g [hi{Sl) . . . hn-liSn-l)\Gn-l]- 

Thus, by (45), 

E,„ [/ii(5i) . . . K{Sn)\gn] = E,o [h{Si) . . . /i„_i(5„_i)|g„_i]E,„[/i„(S„)|g„]. 
Therefore, by a straightforward induction, we have 

n 

E,,[hi{Si)...K{Sn)\gn] =l[B,,[hi{Si)\ Gi]. 

1=1 

Taking for j ^ i, hj = 1, leads to 

(47) E,o [hi{Si)\ Gn] = E,„ [h.,{Si)\ Gi] . 

Hence, 

n 

B,,[hi{Si)...K{Sn)\Gn] ='[[E,,[hi{Si)\ Gn]- 

i=l 

This shows that 

... yn 

and this directly induces the expected result. For the second conditional independence, 
let now hi : — )• R and /i2 : E^~^^ — )• R be some bounded measurable functions. 
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a{Zi^i,Zi) C Gn, thus, 

Et,^ [hi{Si)h2{Zo, Zn)\cr{Zi^i, Zi 



E 



1^0 



(48) 



E 



1^0 



B^^ [hi{Si)h2{Zo, ...,Zn)\ Gn] \(T{Zi^i, Z., 

h2{ZQ, . . . ,Zn)Ey^\h\{Si)\ \ a{Zi_i,Zi) 
We shall prove that 

(49) E,„ [hi{Si)\ Gn] = E,„ [hi{Si)\a{Zi_i, Z,)] . 

By (47), we have 

E.o[/il(S.)| Gn] =E,J/li(5,)|fT(Zo,...,Zi)]. 

Therefore, in order to state (49), we have to prove that 



(50) 



a{Si) ± fT(Zo, . . . , Zi_2) 



From the dynamic (1), we have 

a{5i-i,ei-i) ^- a{Zo, ... , Zi-2) V a{Zi^i). 
Thus, in the light of Proposition 6.8 of [17] in the direction =^, we have 



(51) 



(T((5i„i,ei_i) ± a{Zo, . . . , Zi^2) 



Furthermore, it is easy to see that 

(52) a(Zo, . . . , Zi_2) ± o{Zi^i). 

Therefore, with (51), (52) and Proposition 6.8 of [17] again, but in the direction <^, we 
have 

a{Zi^i,6i-i,ei-i) ± a{Zo, . . . , Zi_2)- 

Furthermore, we have the equality of the cj-fields 

cr(Zj_i, Zi, Ej-i) = (T(Zj_i, (5i_i, Ej-i), 
since Zi is generated by Zi^i and the random errors 6i^i and Thus, 
a{Zi) V a{Zi^i,6i-i,ei-i) ± a{Zo, . . . , Zi_2)- 

Thus, on the strength of Proposition 6.8 of [17] again, in the direction =^, we have 

(j(Zj_i, Jj_i,ej_i) ± cr(Zo, . . . , Zj_2)- 

This states (50) since the time Si is generated from Zi-i and the error (Jj-i. Therefore, we 
prove (49). As a consequence, plugging (48) and (49) yields to 

[hi{Si)h2{Zo, . . ., Zn)\a{Zi^i, Zi)] 

= E,„ [hiiSi)\aiZi^i,Zi)]B,, [h2{Zo, Z„)|a(Z,_i, Zi)] , 

showing the expected result. □ 
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